Spatiotemporal Coding in ANVIL
نویسنده
چکیده
We present a new coding mechanism, spatiotemporal coding, that allows coders to annotate points and regions in the video frame by drawing directly on the screen. Coders can not only attach labels to time intervals in the video but can specify a possibly moving region on the video screen. This opens up the spatial dimension for multi-track video coding and is an essential asset in almost every area of video coding, e.g. gesture coding, facial expression coding, encoding semantics for information retrieval etc. We discuss conceptual variants, design decisions and the relation to the MPEG-7 standard and tools.
منابع مشابه
Annotating and Measuring Multimodal Behaviour - Tycoon Metrics in the Anvil Tool
We demonstrate how the Tycoon framework can be put to practice with the Anvil tool in a concrete case study. Tycoon offers a coding scheme and analysis metrics for multimodal communication scenarios. Anvil is a generic, extensible and ergonomically designed annotation tool for videos. In this paper, we describe the Anvil tool, the Tycoon scheme/metrics, and their implementation in Anvil for a v...
متن کاملSpatiotemporal Kriging with External Drift
In statistics it is often assumed that sample observations are independent. But sometimes in practice, observations are somehow dependent on each other. Spatiotemporal data are dependent data which their correlation is due to their spatiotemporal locations.Spatiotemporal models arise whenever data are collected across bothtime and space. Therefore such models have to be analyzed in termsof thei...
متن کاملMulti-Scale Locality-Constrained Spatiotemporal Coding for Local Feature Based Human Action Recognition
We propose a Multiscale Locality-Constrained Spatiotemporal Coding (MLSC) method to improve the traditional bag of features (BoF) algorithm which ignores the spatiotemporal relationship of local features for human action recognition in video. To model this spatiotemporal relationship, MLSC involves the spatiotemporal position of local feature into feature coding processing. It projects local fe...
متن کاملSensitivity of climate simulations to radiative effects of tropical anvil structure
Climate sensitivity to the representation of tropical anvil is investigated in a version of the National Center for Atmospheric Research Community Climate Model. Common features of tropical anvil generation and structure, consistent with observations and cloud resolving models, are incorporated into a simple prognostic anvil parameterization. These features include anvil convective origin, vert...
متن کاملZender and Kiehl : Climate Sensitivity to Anvil Structure 3
Climate sensitivity to the representation of tropical anvil is investigated in a version of the National Center for Atmospheric Research Community Climate Model. Common features of tropical anvil generation and structure, consistent with observations and cloud resolving models, are incorporated into a simple prognostic anvil parameterization. These features include anvil convective origin, vert...
متن کامل